Two-sided confidence intervals for the single proportion: comparison of seven methods
Corresponding Author
Robert G. Newcombe
Senior Lecturer in Medical Statistics, University of Wales College of Medicine, Heath Park, Cardiff CF4 4XN, U.K.
Senior Lecturer in Medical Statistics, University of Wales College of Medicine, Heath Park, Cardiff, CF4 4XN, U.K.Search for more papers by this authorCorresponding Author
Robert G. Newcombe
Senior Lecturer in Medical Statistics, University of Wales College of Medicine, Heath Park, Cardiff CF4 4XN, U.K.
Senior Lecturer in Medical Statistics, University of Wales College of Medicine, Heath Park, Cardiff, CF4 4XN, U.K.Search for more papers by this authorAbstract
Simple interval estimate methods for proportions exhibit poor coverage and can produce evidently inappropriate intervals. Criteria appropriate to the evaluation of various proposed methods include: closeness of the achieved coverage probability to its nominal value; whether intervals are located too close to or too distant from the middle of the scale; expected interval width; avoidance of aberrations such as limits outside [0,1] or zero width intervals; and ease of use, whether by tables, software or formulae. Seven methods for the single proportion are evaluated on 96,000 parameter space points. Intervals based on tail areas and the simpler score methods are recommended for use. In each case, methods are available that aim to align either the minimum or the mean coverage with the nominal 1−α. © 1998 John Wiley & Sons, Ltd.
References
- 1 M. J. Gardner and D. G. Altman (eds). Statistics with Confidence. Confidence Intervals and Statistical Guidelines, British Medical Journal, London, 1989.
- 2 Rothman, K. Modern Epidemiology Little Brown, Boston, 1986.
- 3 Vollset, S. E. ‘Confidence intervals for a binomial proportion’, Statistics in Medicine, 12, 809–824 (1993).
- 4
Newcombe, R. G.
‘Interval estimation for the difference between independent proportions: comparison of eleven methods’,
Statistics in Medicine,
17,
873–890
(1998).
10.1002/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I CASPubMedWeb of Science®Google Scholar
- 5 Newcombe, R. G. ‘ Improved confidence interval methods for the difference between binomial proportions based on paired data’. Submitted for publication.
- 6 Blyth, C. R. and Still, H. A. ‘Binomial confidence intervals’, Journal of the American Statistical Association, 78, 108–116 (1983).
- 7 Turnbull, P. J., Stimson, G. V. and Dolan, K. A. ‘Prevalence of HIV infection among ex-prisoners in England’, British Medical Journal, 304, 90–91 (1992).
- 8 Clopper, C. J. and Pearson, E. S. ‘The use of confidence or fiducial limits illustrated in the case of the binomial’, Biometrika, 26, 404–413 (1934).
- 9 C. Lentner (ed). Geigy Scientific Tables, 8th edition, volume 2, Ciba-Geigy, Basle, 1982.
- 10 Miettinen, O. S. ‘Estimation of relative risk from individually matched series’, Biometrics, 26, 75–86 (1970).
- 11 Miettinen, O. S. Theoretical Epidemiology, Wiley, New York, 1985, pp. 120–121.
- 12 Lancaster, H. O. ‘The combination of probabilities arising from data in discrete distributions’, Biometrika, 36, 370–382 (1949).
- 13 Stone, M. ‘The role of significance testing. Some data with a message’, Biometrika, 56, 485–493 (1969).
- 14 Berry, G. and Armitage, P. ‘Mid-P confidence intervals: a brief review’, Statistician, 44, 417–423 (1995).
- 15 Miettinen, O. S. and Nurminen, M. ‘Comparative analysis of two rates’, Statistics in Medicine, 4, 213–226 (1985).
- 16 Barnard, G. A. Personal communication, 1992.
- 17 Wilson, E. B. ‘Probable inference, the law of succession, and statistical inference’, Journal of the American Statistical Association, 22, 209–212 (1927).
- 18
Cox, D. R. and
Hinkley, D. V.
Theoretical Statistics,
Chapman and Hall, London,
1974.
10.1007/978-1-4899-2887-0 Google Scholar
- 19 Fleiss, J. L. Statistical Methods for Rates and Proportions, 2nd edn, Wiley, New York, 1981.
- 20 Pratt, J. W. ‘A normal approximation for binomial,F, beta, and other common, related tail probabilities. II’, Journal of the American Statistical Association, 63, 1457–1483 (1968).
- 21 Blyth, C. R. ‘Approximate binomial confidence limits’, Journal of the American Statistical Association, 81, 843–855 (1986).
- 22 Mehta, C. and Patel, N. StatXact. Statistical Software for Exact Nonparametric Inference, Version 2. Cytel, Cambridge, MA, 1991.
- 23 Garwood, F. ‘Fiducial limits for the Poisson distribution’, Biometrika, 28, 437–442 (1936).
- 24 Cohen, G. R. and Yang, S. Y. ‘Mid-p confidence intervals for the Poisson expectation’, Statistics in Medicine, 13, 2189–2203 (1994).
- 25
Lindley, D. V.
Introduction to Probability and Statistics from a Bayesian Viewpoint.
Part 2. Inference,
Cambridge University Press, Cambridge,
1965,
pp. 141–148.
10.1017/CBO9780511662973 Google Scholar
- 26 Altman, D. G. Practical Statistics for Medical Research, Chapman and Hall, London, 1991, pp. 161–165.
- 27 Angus, J. E. ‘Confidence coefficient of approximate two-sided confidence intervals for the binomial probability’, Naval Research Logistics, 34, 845–851 (1987).
- 28 Angus, J. E. and Schafer, R. E. ‘Improved confidence statements for the binomial parameter’, American Statistician, 38, 189–191 (1984).
- 29 Anderson, T. W. and Burstein, H. ‘Approximating the upper binomial confidence limit’, Journal of the American Statistical Association, 62, 857–861 (1967).
- 30 Anderson, T. W. and Burstein, H. ‘Approximating the lower binomial confidence limit’, Journal of the American Statistical Association, 63, 1413–1415 (1968).
- 31 Fujino, Y. ‘Approximate binomial confidence limits’, Biometrika, 67, 677–681 (1980).
- 32 Ghosh, B. K. ‘A comparison of some approximate confidence intervals for the binomial parameter’, Journal of the American Statistical Association, 74, 894–900 (1979).
- 33 Kendall, M. G. and Stuart, A. The Advanced Theory of Statistics. Volume 2. Inference and Relationship, 2nd edn, Griffin, London, 1967, pp. 101–102.
- 34 Bickel, P. J. and Doksum, K. A. Mathematical Statistics: Basic Ideas and Selected Topics, Holden-Day, San Francisco, 1977, p. 155.
- 35
Pratt, J. W. and
Gibbons, J. D.
Concepts of Nonpar ametric Theory,
Springer Verlag, New York,
1981.
10.1007/978-1-4612-5931-2 Google Scholar
- 36 Wichmann, B. A. and Hill, I. D. ‘ An efficient and portable pseudorandom number generator’, in P. Griffiths and I. D. Hill (eds), Applied Statistics Algorithms, Ellis Horwood, Chichester, 1985.
- 37 Newcombe, R. G. ‘Confidence intervals for a binomial proportion’, Statistics in Medicine, 13, 1283–1285 (1994).
- 38 Gardner, M. J. Confidence Interval Analysis, British Medical Journal, London, 1989.